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Website technology have created both opportunities and challenges for higher 
education. Information systems as online learning medium need to pay 
attention to access, quality and user needs in order to improve the quality of 
e-learning services. The research objective is to determine user acceptance of 
the system. The service quality method as identification in solving problems. 
The research focus on the analysis of five dimensions namely measurable, 
reliability, responsiveness, assurance and empathy. The research was 
conducted at the research college at Muria Kudus University. The results state 
that the assessment model of a system on the website can be completed 
properly. The level of effectiveness is carried out with respondents as users 
through the distribution of questionnaires. The results of the analysis with a 
statistical correlation performance test of 0.985 were declared accepted with 
a validity level of 97% indicating that the success of the system implemented 


Technology was from the acceptance side. The higher the empathy with service quality 
and performance expectations, the greater the student's intention to receive 
online education services. This research is a reference for developing 
information systems on e-learning. 
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1. INTRODUCTION 

Digital learning has been implemented in learning, but not many have paid attention to the needs of 
technology for its users as material for recommendations and further improvements. Evaluation is conducted 
to determine effectiveness in management. Quality can be said to be good if the system is tested during its 
implementation. Improvements are used to measure the quality of operation and the level of user usage. 
Effectiveness of social media with edmodo and personal blog with WordPress in developing teacher 
technology skills based on gamification [1]. The problem is that there are medium online learning/massive 
open online courses (MOOC) providers that do not pay attention to access, quality and equality from users, so 
it is necessary to measure MOOC performance [2]. The role of information and communication technology in 
online learning is very important, so it is necessary to pay attention to quality, access, and user needs [3], argues 
that the evaluation of e learning performance including the evaluation of interaction in the classroom 
(traditional), evaluation of pedagogical actions, evaluation of administrative management and evaluation of 
multimedia resources. Improvement of e learning services to support continuous education performance. The 
main indicator of successful website development is increased user satisfaction. This study is based on a quality 
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model of learning management system and lecture materials, so that the contribution as an online learning 
medium can be fulfilled [4]. The application of effective e-learning as a means of online learning information 
systems at universities also depends on the level of student needs in using technology [5]. The quality of service 
and the availability of technology as a means of information system infrastructure can support sustainability 
education [6], [7]. 

Service quality model can be applied to all organizations, including self service that has been done by 
[8], where the contribution of this study uses a causal statistical model on the acceptance of learning 
management system instructors. Five main factors, namely the quality of learning, instructors, information, 
systems, and institutions as a determinant of the performance of e-learning services have an effect on 
perceptions of usefulness by 71.2% and academic achievement of 70.6% in e-learning system learning [9]. 
Analysis of academic services using the five dimensions of Servqual has been carried out in research [10]. The 
test results obtained an accuracy rate of 91.07% with a degree of error of 8.93% indicating student satisfaction 
in higher education performance can be seen from a good work environment. Another research that has been 
conducted by Altuntas on system acceptance uses the service quality scale and the analitycal hierarchi process 
method. The proposed classification model to determine the impact of the parameters of each service element. 
The results prioritize the main factors of service [11]. Service quality is widely used to evaluate the quality of 
library institutions, the five elements used include tangibles, reliability, responsiveness and assurance and 
empathy. The average expected value of each attribute is identified as a deficiency. Tests are carried out by 
statistical test tests [12]. Educational technology quality services need to pay attention to the quality, access, 
and equity of learning at lower costs and the availability of relevant content. Mobile technology has relevance 
to student acceptance of m-learning [13]. 

The acceptance of information technology based on an integrated meta-analysis of artificial 
intelligence (AI) to predict the behavioral intentions of users of customer relationship management (CRM) 
organizations through a study of the activities of online media providers that have an impact on user satisfaction 
has been carried out in research [14]. Acceptance of technology on the usefulness of e-learning, social, and 
organizational factors influence the intentions and behavior of users of information systems [15]-[17]. The 
structure of the assessment model as a general research framework through the design science paradigm 
approach in the IS research framework from other models such as unified theory of acceptance and use of 
technology (UTAUT) can be a reference for new methodologies [18]. Understanding the framework is a major 
factor in the modern era in technology, one of which is in the process of achieving academic achievement [19]. 
The innovation of trends business information systems from various fields provides great opportunities such 
as cost finance, performance expectations, motivation and social influence. This research study was conducted 
by Zwain where the results showed an increase in targets in all segments in building higher education [20]. 
The development of learning in the 5.0 revolution era has a positive impact on sustainable education. The role 
of educational service quality in blended learning shows that 87.34% of students feel satisfied using 
information systems [21]. Another effort that needs to be considered is the management of universities. One 
of them is the fulfillment of infrastructure to support the services of the human resource community [22]. 
Acceptance assessment on the website can also use the Delphi Fucom algorithm, differences in quality gaps 
obtained significant results on user behavior [23], [24]. The education sector is a concern for all parties, so it 
needs to be improved to meet the management needs of a system and analyzing user perception factors [25]. 
Website quality affects user ease which has a positive impact on students' behavioral intentions to use 
commercial online tutorials [26]. 

Based on the description of previous research, this study focuses on the service quality (ServQual) 
model because this tool is related to online information system services, and is focused on assessment after 
using an online learning system. The service quality method can be used to evaluate the acceptance of the 
website system with five dimensions to obtain the results of the validity of user perceptions of the services 
received. Both of these models can be used as a measurement through the quality of service from the attributes 
of each dimension, so that the gap value will be obtained which is the difference between the user's perception 
of the service received and the user's expectation of the service that will be received. 


2. METHOD 

This study uses quantitative methods. The data was obtained through an online questionnaire 
distribution survey. The location and subject of the research were carried out at the research university 
institution, namely Muria Kudus university. The focus of the research is on students using the SUNAN e- 
learning website. This research was conducted in three stages. The first stage; determines the ServQual 
dimensions. The scale includes five dimensions, namely tangibles describing physical facilities, equipment, 
and appearance of personnel and the presence of users, reliability namely the ability to provide accurate and 
reliable services, responsiveness namely the willingness to help users and give proper attention, assurance is a 
service facility that provides trust and confidence, and empathy includes caring and individual attention to 
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users. The second stage is compiling and distributing questionnaires. The third stage is processing the data 
from the questionnaire. The data from the distribution of the questionnaires before being analyzed with 
validation and regression performance tests. Quantitative data calculation using SPSS version 26 [27]. 
Specifically, the research stages used are shown in Figure 1. 


Questionnaire results 


2. Determine the 
questionnaire model 
3. Determining the number 
of samples 


Questionnaire Distribution 


Data Analysis 


Reliability Test 


Processing of research results 
Conclusion 


At the research stage, the research design begins with the identification of variables and dimensions 
to be measured, consisting of independent variables (Xn), including tangibles (X1), reliability (X2), 
responsiveness (X3), assurance (X4), and empathy (X5). while the dependent variable (Y) is the satisfaction 
of users of information systems. Each dimension has several questions and is answered in a value range of | 
to 5, where the number | represents feelings of strongly disagree (strongly disagree), 2 (disagree), 3 (neutral), 
4 (agree), and a scale of 5 (strongly agree) with a total of 14 questions. The questions on the questionnaire are 
adjusted to the service quality (ServQual) model. The next stage is collecting data from the results of 
distributing questionnaires, and finally, data processing with data analysis and validity and reliability tests. 


Figure 1. Research stages 


3. RESULTS AND DISCUSSION 

Collecting respondent data from as many as 8,000 students who use the e-learning system in the even 
semester of 2021-2022. Filling out the questionnaire at the end of the semester period through online 
distribution using a tool in the form of a Google Form Respondents who returned and filled out the 
questionnaire were 6413 (80.16%). This questionnaire consists of two parts. The first section includes 
respondents’ demographic information, such as gender, study program, frequency of e-learning access, and 
average time spent e-learning. The second part contains statements related to the variables studied in this study, 
including content suitability, content benefits, content completeness, system ease, access speed, attractive 
appearance, structured display, easy-to-understand material content, discussion forums, availability of content 
for submitting assignments, content to collect exam questions and answers, control of online learning, learning 
motivation, and convenience using SUNAN e-learning. The questionnaire consisted of 14 questions, which 
were further grouped according to the parameters of each question into five separate dimensions. The 
classification is as shown in Table 1. 
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Table 1. Validity test 


Code Question ServQual/Variable Score 
question dimension (1-5) 
Ql Does SUNAN's e-learning system provide content that fits the needs Tangible (X) 
Q2 Does the SUNAN website contain useful content 
Q3 Is the SUNAN application content completing enough 
Q4 Is SUNAN's e-learning system easy to use 
Q5 Access speed (When accessing SUNAN e-learning is stable and smooth) Reliability (Y) 
Q6 The appearance of the SUNAN class is made interesting Responsiveness (Z) 
Q7 The appearance of the SUNAN class is structured/systematic 
Q8 Are the features on the task menu on the SUNAN website easy to understand 
Q9 The interaction facilities between lecturers and students available in the SUNAN Assurance (T) 
class are quite complete 
Q10 There is an evaluation facility for learning outcomes Empaty (U) 
Qll In the SUNAN class, an evaluation of the implementation of lectures is carried 
out at the end of the meeting 
Ql12 SUNAN's e-learning makes it possible to control the online learning process 
Q13 Does the interactivity of learning through SUNAN's e-learning increase 
motivation/enthusiasm to learn 
Ql4 Is SUNAN's e-learning media provide communication between lecturers and 


students and fellow students 


After the next grouping, test the validity. The results of the validity test are used to measure the 
variables assurance, responsiveness, reliability, facilities, and empathy. Reliability was carried out with a 
normal distribution test, and the correlation of the correlated variables was 0.01. Thus, all statement items, 
according to the variables, indicate the level of valid information system users. The results of the respondents’ 
reliability test analysis resulted in a normal distribution coefficient (Cronbach's alpha) above 0.9. It can be said 
that the instrument used to measure the five variables has high reliability, as shown in Table 2. 

The next stage is hypothesis testing. The proposed hypothesis has been accepted with a significance 
level of 95%. The correlation is obtained by measuring linear regression analysis with the value of the 
respondent's data and five variables. Based on the analysis, it is known that the variables assurance, 
responsiveness, reliability, facilities, and empathy have a significant effect on users. Overall, the five 
dimensions of servqual are able to explain the effect on users by 37.6%. The results of the regression analysis 
are shown in Table 3. The presentation of data in descriptive analysis produces data on the minimum value, 
maximum, mean, standard deviation, data range, and total score. In the statement of the fifth item (X5), it is 
significant towards empathy (U) with a total of 6413 respondents, an average of 3.99, the standard deviation is 
1.1, and the data range is 3. Dimension U is the dependent variable. The results of the residuals analysis are 
shown in Table 4. 


Table 2. Reliability test one 


Sample Kolmogorov Smirnov Test 


xX Y Z T U 

N 6413 6413 6413 6413 6413 
Normal Parameters*> Mean 16.4032 3.8211 12.1904 3.9774 19.9796 
Std.Deviation 3.05566 .88586 2.29141  .82363 3.90108 

Most extreme differences Absolute .176 226 .203 251 179 

Positive .137 177 77 206 155 

Negative -.176 -.226 -.203 -.251 -.179 

Test statistic .176 226 .203 251 179 

Asymp.Sig.(2-tailed) .000° .000° .000° .000° .000° 


a. Test distribution is Normal; b. Calculated from data; c. Lilliefors Significance Correction 


After analyzing the residuals to find out from the regression equation using the user-dependent 
variable (U) as the information in the previous calculation, the results are depicted in the form of a histogram 
graph. This graph illustrates the frequency distribution of the import value compared to the normal distribution 
graph where the number of samples (N) is 6,413 with a standard deviation of 1.00 and the mean value is 3.4 at 
an altitude of 2.7 as shown in Figure 2. while the normal regression graph is the normal P-P plot graph. This 
graph depicts the frequency distribution of the overall average import value according to the test distribution. 
Thus, the distribution of import values follows a normal distribution, as shown in Figure 3. The results of the 
linear regression analysis test reached 0.985, which has a significant correlation with a validity of 97%. It is 
expected that the large number of respondents can provide significant results for improving the quality of 
information systems. 
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Correlations 
U 4 Y Zz T 
Pearson correlation U 1.000  .871 778 .905 897 
xX 871 1.000 = .743 892 830 
Y 778 .743, 1.000.777 .753 
Z ~~ .905 892 777 1.000 863 
T  .897 830 753 .863 1.000 
Sig.(1-tailed) U .000 000 .000 000 
xX ~~ .000 ‘ 000 .000 000 
Y — .000 .000 : .000 000 
Z ~~ .000 .000 000 ‘ 000 
T  .000 .000 000 .000 ‘ 
N U 6431 6431 6431 6431 6431 
X 6431 6431 6431 6431 6431 
Y 6431 6431 6431 6431 6431 
Z 6431 6431 6431 6431 6431 
T 6431 6431 6431 6431 6431 
Table 4. Statistical analysis 
Residuals Statistics* 
Minimum Maximum Mean _ Std.Deviation N 
Predicted value 2.0236 4.9536 3.9959 .73246 6413 
Std.predicted value -2.693 1.308 .000 1.000 6413 
Standard error of predicted value 004 .030 .007 003 6413 
Adjusted predicted value 2.0222 4.9542 3.9959 73246 6413 
Residual - 1.85665 1.66161 00000 26878 6413 
Std.residual -6.937 6.180 .000 1.000 6413 
Stud.residual -6.937 6.188 .000 1.001 6413 
Deleted residual -1.87376 1.66567 00000 26923 6413 
Stud. deleted residual -6.963 6.206 .000 1.001 6413 
Mahal.distance .249 77.083 3.999 5.481 6413 
Cook’s distance .000 089 .000 002 6413 
Centered leverage value .000 012 001 001 6413 
a. Dependent Variable: U 
Histogram 
Dependent Variable: U 


6 0 


Regression Standardized Residual 


Figure 2. Regression graph 


Figure 3. Graph of normal regression 
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4. CONCLUSION 

The study found that the variables tangibles, reliability, responsiveness, assurance, and empathy had 
a significant effect on the acceptance of information system users’ behavior on the Sunan e-learning website 
using the ServQual model with five dimensions. The quality of online learning services needs to pay attention 
to all aspects of the system according to user needs. E-learning is one of the innovations in information 
technology that provides information, knowledge, and convenience for students to learn flexibly. Acceptance 
evaluation is used as a benchmark for the development of e-learning system implementation in higher 
education. 
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